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5 Attorney Docket 1 9 1 86-000650US 

CROSS REFERENCE TO RELATED APPLICATIONS 
[0001] The following references are herein incorporated in their entirety for all 
purposes: 

a) Commonly assigned U.S. Patent No. 6,373,406, entitled "Information 
10 Additive Code Generator and Decoder for Communication Systems" (hereinafter 

"Luby I"); 

b) Commonly assigned U.S. Patent Application No. 09/768,843, filed January 
23, 2001, entitled "Methods and Apparatus for Scheduling, Serving, Receiving 
Media-on-Demand For Clients, Servers Arranged According to Constraints and 

1 5 Resources" (hereinafter "MOD"); 

c) Commonly assigned U.S. Patent Application No. 10/032,156, filed 
December 21, 2001, entitled "Multi-stage Code Generator and Decoder for 
Communication Systems" (hereinafter "Raptor"); 

d) Commonly assigned U.S. Patent Application No. 10/367,573, filed 

20 February 14, 2003, entitled "Systems and Methods for Reliably Communicating the 
Content of a Live Data Stream" (hereinafter "Rasmussen"); and 

e) Commonly assigned U.S. Patent Application No. 10/459,370, filed June 10, 
2003, entitled "Systems and Processes for Decoding Chain Reaction Codes Through 
Inactivation" (hereinafter "Shokrollahi"). 

25 BACKGROUND OF THE INVENTION 

[0002] The present invention relates generally to systems and methods for 
broadcasting information, and more particularly to systems and methods for 
broadcasting information, data or content, to intermittently available receivers, such 
as mobile receivers. 

30 [0003] A conventional approach to broadcasting data to a large number of receivers 
is referred to as the "data carousel" protocol. Using this approach, broadcast data is 
usually split into equal-sized packets, each of which forms a section in a data 
carousel. Each section is then broadcast over a specific period of time, and the data 
carousel continues to repeat to transmit those data portions that one or more receivers 

*35 did not receive. Usually the broadcasting terminal (e.g., a network server, satellite or 
terrestrial transmitter) will need to transmit the data in the repeated fashion many 
times since it is usually not possible to synchronize the receivers to receive the 



5 transmitted data during one transmission period. The continued transmission of the 
same data set reduces the transmitter's efficiency, and as the transmission cycles 
continue, successively fewer receivers benefit from the transmission. 

[0004] Further complicating this approach is the observation that in many 
applications, each receiver, through its normal course of operation, may itself be 

10 switched on and off during a transmission period. Systems such as automotive-based 
data receivers (e.g., on-board navigation systems), global positioning systems, cellular 
handsets, and portable computers employing 802. llx wireless communication 
protocols are but a few examples of such receivers. The sheer number of these 
receivers combined with their intermittent operation greatly increases the number of 

15 transmission cycles required to ensure that a large majority of the receivers have 
received all data segments. 

[0005] Forward error/erasure correction (FEC) represents a conventional 
improvement to the data carousel approach. In this approach, a forward error 
correction algorithm is applied to each of the data segments, producing redundant data 

20 for that segment. This approach is an improvement over the data carousel, as the 

receiver needs only receive a subset of each data segment to correctly decode it. This 
results in fewer transmission cycles being needed to disseminate the broadcast data to 
a large majority of receivers. While providing an improvement, the FEC data 
carousel systems still has the disadvantages that: (1) each receiver must still receive a 

25 relatively large portion of each data segment; and (2) prior art FEC codes used in such 
data carousel systems, such as Reed-Solomon codes, require computational resources 
well beyond that which is available or commercially feasible in many applications. 
As noted above, many of the intermittently available receivers will not remain 
continuously on during a transmission period, and accordingly, a large number of 

30 repeated transmission cycles will be needed. It is expected that in practice some 
receivers will receive all segments quickly, while others will take a long time, 
resulting in the aforementioned condition of repeatedly broadcasting previous data 
over a long period to achieve a high rate of successful receptions. 

[0006] What is therefore needed are systems and methods for broadcasting data to 
35 receivers, including mobile and intermittently available receivers, in a more efficient 
manner. 
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5 BRIEF SUMMARY OF THE INVENTION 

[0007] The present invention describes new systems and methods for broadcasting 
data to all types of receivers, including those intermittently available such as mobile 
receivers, in a highly efficient manner using information additive coding. Information 
additive coded information (herein referred to as "information additive codes," 

10 exemplary embodiments of which include "LT Codes/' "Raptor Codes," and "Chain 
Reaction Codes" described in the assignee's references incorporated herein) exhibits 
the unique property that any coded segment can be used to recover the original source 
data. Accordingly, a receiver in such a system need only receive some threshold 
amount of the coded data, regardless of what particular segment it contains, or when it 

15 is received. The receiver in such a system also does not rely on a backchannel to 

ensure reception of all transmitted data. These properties make the present invention 
useful for broadcasting systems, and particularly advantageous for systems 
broadcasting to intermittently available receivers, as data can be recovered efficiently 
at all times during reception periods. 

20 [0008] In a particular embodiment of the invention, a broadcasting system is 

described having one or more information additive code transmitters and one or more 
information additive code receivers. Each of the information additive code 
transmitters includes an encoder configured to receive source data and to produce 
information additive code therefrom. Each of the information additive code receivers 

25 includes a decoder configured to receive the information additive code and to 
reconstruct therefrom substantially a copy of the source data. 

[0009] This and other systems and methods of the present invention are provided 
below, a better understanding of which can be obtained with reference to the 
following figures and description. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] Figs. 1 A and IB illustrate a system and corresponding method for 
broadcasting information additive codes in accordance with the present invention. 

Fig. 2 A illustrates a first embodiment of the broadcast transmitter shown in Fig. 1 A in 
accordance with the present invention. 
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5 Fig. 2B illustrates a method of converting input symbols into a coded transmission 
using the broadcast transmitter shown in Fig. 2A in accordance with one embodiment 
of the present invention. 

Fig. 3 A illustrates a second embodiment of the broadcast transmitter shown in Fig. 1 A 
in accordance with the present invention. 

10 Fig. 3B illustrates one embodiment of the symbol encoder shown in Fig. 3 A in 
accordance with the present invention. 

Fig. 3C illustrates a method of converting input symbols into a coded transmission 
using the broadcast transmitter shown in Fig. 3 A in accordance with one embodiment 
of the present invention. 

15 Fig. 4 A illustrates a simplified block diagram of an improved encoder in accordance 
with the present invention. 

Fig. 4B illustrates a method for encoding data with the improved encoder shown in 
Fig. 4A in accordance with one embodiment of the present invention. 

Fig. 4C illustrates a second embodiment of the improved encoder comprising a 
20 multiple engine encoder. 

Fig. 5 A illustrates a general encoding process which may be used in system 
broadcasting live streaming data. 

Fig. 5B illustrates a specific embodiment for the encoding process for a live data 
stream in accordance with the present invention. 

25 Fig. 5C illustrates a signal timing diagram for signals communicated in accordance 
with the method of Fig. 5B. 

Fig. 6A illustrates a first embodiment of a receiver, as might be used in the system of 
Fig. 1 A, comprising a single-stage information additive code receiver in accordance 
with the present invention. 

30 Fig. 6B illustrates a method of recovering input symbols from a coded transmission 
using the receiver shown in Fig. 6A. 

Fig. 7A illustrates a second embodiment of the receiver comprising a multistage 
information additive code receiver in accordance with the present invention. 
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5 Fig. 7B illustrates one embodiment of the symbol decoder in accordance with the 
invention. 

Fig. 7C illustrates a method of recovering input symbols from a coded transmission 
using the receiver shown in Fig. 7A. 

Fig. 8 A illustrates a method for decoding the information additive codes using 
10 inactivation in accordance with one embodiment of the present invention. 

Fig. 8B illustrates one embodiment of the start-up process illustrated in Fig. 8 A. 

Fig. 8C illustrates a first embodiment of the source symbol selection and deactivation 
process illustrated in Fig. 8A. 

Fig. 8D illustrates one embodiment of the source symbol recovery process illustrated 
15 in Fig. 8 A. 

Fig. 9A illustrates one embodiment of the present invention comprising a system for 
broadcasting data to a large number of mobile terminals. 

Fig. 9B illustrates another embodiment of the present invention comprising a system 
for broadcasting live streaming data to a large number of mobile terminals. 

20 [001 1] For clarity and convenience, features and components which are identified in 
earlier drawings retain their reference numerals in subsequent drawings. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 
[0012] The broadcasting system and methods of present invention can be used in a 
variety of applications, particularly in mobile systems in which the receiver may be 

25 switched on and off during its normal course of operation. For example, the system 
may be used to update map databases in automotive-based receivers periodically 
without the driver's knowledge or intervention. In other applications, the 
broadcasting system may be used to send passenger manifests to train conductors 
while the train is in motion, updating and broadcasting weather information to 

30 receivers installed on boats and planes, or sending information to PDAs, cell phones, 
and the like. Other applications of the present invention are further described below 
with reference to Figs. 9A and 9B. 
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5 System Overview 

[0013] Figs. 1A and IB illustrate a general block diagram of system and 
corresponding method for broadcasting information additive codes in accordance with 
the present invention. In a particular embodiment described below, the system is 
configured to broadcast information additive codes to a number of mobile terminals, 
1 0 for example a number of automobiles. 

[0014] Referring first to Fig. 1 A, the exemplary broadcast system 100 includes one 
or more information additive code transmitters (transmitters) 1 10i_n, each of which 
sends a coded transmission 1 15i_n across a primary channel 120 to one or more 
information additive code receivers (receivers) 130i_n. The coded transmission 115 

1 5 comprises the information additive codes which are modulated or multiplexed in the 
appropriate manner to facilitate transmission to the receivers 130i_n. In those 
embodiments in which no multiplexing or modulation is needed for broadcast 
transmission, the term coded transmission will refer to the information additive codes 
themselves. The information additive codes are comprised of output symbols, the 

20 generation of which is further described below. 

[0015] In a particular embodiment as shown, the source data 105 is supplied to two 
or more transmitters 1 10i_ N . This embodiment can be employed to provide 
redundancy over the primary channel 120, or to increase the effective reception rate of 
the receivers 130, as the information additive receivers are capable of decoding the 

25 coded transmission upon receiving any suitable number of coded blocks, without 

regard to the particular data block received. In an alternative embodiment, different 
source data is supplied to different transmitters. In this instance, different transmitters 
can be used to simultaneously transmit different content, among which the receiver 
can selectively choose. In a third embodiment, the source data 105 comprises diverse 

30 data multiplexed onto a single stream supplied to the transmitters 1 10i- N . As in the 
previous embodiment, this arrangement provides the ability to concurrently broadcast 
several different programs to the receivers 130i_ N from which a receiver can 
selectively choose. 

[0016] One or more of the receivers (receiver 130i as shown) are configured to 
35 receive the coded transmission 1 14 via a secondary channel 140. The secondary 
channel 140 provides an alternate communication route should reception via the 
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5 primary channel not be possible. The secondary channel 140 preferably comprises a 
channel complimentary to that of the primary channel, for example, a telephone or 
cable modem line or terrestrial link in the instance in which the primary channel 120 
is a satellite link. In a particular embodiment, the secondary channel 140 provides 
additive information codes data which have not been sent over the primary channel 
.10 120. To achieve this, either the secondary channel 140 has its own dedicated additive 
information codes transmitter, or some encoded data is diverted from primary channel 
120. 

[0017] The transmission channel (primary 120 or secondary 140) may comprise any 
of several communication architectures suitable for the particular multicast or 

15 broadcast application. For example, the transmission channel may comprise an 
internal bus architecture operable to communicate data within a microprocessor or 
computer system. In another embodiment, the channel comprises an external 
computer network, such as a local area network, a medium area network, wide area 
network, or the Internet, in which one source (e.g., a server) broadcasts data to one or 

20 more computers. In a third embodiment, the transmission channel comprises a 

telephone line (analog or digital), cable (electronic or fiber optic), or other structure 
which can guide and support the propagation of a data signal. In a fourth 
embodiment, the channel comprises a free space (RF/electromagnetic or optical 
wavelength) terrestrial or space-based communications link. The mode of 

25 communication employed, e.g., electrical or optical, format of modulation, 

transmission via a guided structure or free space, is a design choice, and any means 
for communicating information from one or more transmitters to one or more 
receivers may be used as a transmission channel in the present invention. Further, a 
recording/storage device 122 N (e.g., tape drive, hard disk drive, memory, etc.) may be 

30 used to record/store the coded transmissions 1 1 5 N broadcast from each transmitter 
130n. The recording/storage devices 122 may be used to provide playback of earlier 
transmitted data when requested. 

[0018] Referring now to Fig. IB, the operation of the system 100 begins at 151 
when the original source data 105 is supplied to one or more of the transmitters 110. 
35 The source data 105 can be in any form or structure, e.g., a data stream, a data file, 
etc., and may comprise a multiplexed stream of diverse data. The source data 105 
may be supplied in a segmented size which is more optimally processed, or the 
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5 segmentation process may occur within the transmitter and/or receiver structures as 
described below. 

[0019] Subsequently at 152, the supplied source data is encoded into information 
additive codes, modulated onto a carrier signal (when needed), and transmitted via the 
primary or secondary channels 120 or 140. In one embodiment, the source data 105 is 
10 encoded using a single-stage information additive code generator described in Luby I. 
In another embodiment, the source data is encoded using a multistage information 
additive code generator as described in Raptor. Exemplary embodiments of such 
encoding systems and processes are further described below. 

[0020] As shown and described above, the coded transmission 1 15 may be sent via 
1 5 two or more transmitters 1 1 Oun in order to provide redundancy, an increased 

reception rate, or multiple data programs. Alternatively, the coded transmission 115 
may be made available to one or more receivers via a secondary channel 140 to 
provide redundancy. As a further alternative, the second channel 140 may carry a 
different coded transmission, such as a different source data or session information, 
20 further described below. 

[0021] The format and size of the coded transmission 115 will vary depending upon 
the particular data application, transmission channel, and receiver requirements. 
Possible formats include UDP packets, MPEG data streams, ATM cell streams, serial 
byte streams, file(s) in a shared storage medium, FDDI data streams or SCSI 
25 command and data streams, satellite transmissions, cellular phone transmissions, PCS 
transmissions, GSM transmissions, HDTV transmissions, or similarly formatted 
transport. Preferably, the coded transmission is composed of atomic medium blocks 
(AMBs) which are native to, or optimally processed by the transmission channel 
and/or the receivers 130. 

30 [0022] At 153, the coded transmission 1 15 is received by one or more of the 

receivers 130, each receiver 130 configured to recover a copy of the source data 105 
therefrom. In one embodiment, the coded transmission 1 15 is decoded using a single- 
stage information additive code decoded as described in Luby L In another 
embodiment, the coded transmission is decoded using a multistage information 

35 additive code decoder as described in Raptor. Exemplary embodiments of such 
decoding systems and processes are further described below. 
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5 Exemplary Broadcast Transmitters and Processes 

[0023] Fig. 2 A illustrates a first embodiment of the transmitter 110, comprising a 
single-stage information additive code transmitter in accordance with the present 
invention. The term "transmitter" is used generically to refer to the unit's function, 
and may comprise a network server, central processing unit or other device from 
10 which instructions or data originate, a satellite or terrestrial radio transmitter, network 
device, or any such unit which is configured to encode and transmit source data as 
described herein. 

[0024] The single-stage transmitter 110 includes a single-stage encoder 210, a 
protocol converter 220, and a transmit module 230. The single-stage encoder 210 
15 includes an input symbol generator 211, symbol encoder 212, key generator 213, 

counter 214, stream identifier 215, and a random number generator 216. The single- 
stage encoder 210 and corresponding method of operation are generally as described 
in Luby I. 

[0025] Input symbol generator 21 1 generates an ordered sequence of one or more 
20 input symbols (IS(0), IS(1), IS(Q), . . . ) from the source data 105, with each input 

symbol having a value and a position (denoted in FIG. 2A as a parenthesized integer). 

The possible values for input symbols, i.e., its alphabet, is typically an alphabet of 2 M 

symbols, so that each input symbol codes for M bits of the input file. The value of M 

is generally determined by the parameters of the system 100, but a general purpose 
25 system might include a symbol size input for input symbol generator 21 1 so that M 

can be varied from use to use. The output of input symbol generator 21 1 is provided 

to a symbol encoder 212. 

[0026] Key generator 213 generates an encoding key for each output symbol to be 
generated by the symbol encoder 212. Each encoding key is generated according to 

30 one of the methods described herein, in Luby I, or any comparable method that 

insures that a large fraction of the keys generated for the same input file are unique, 
whether they are generated by this or another key generator. For example, key 
generator 213 may use a combination of the output of a counter 214, a unique stream 
identifier 215, and/or the output of a random generator 216 to produce each key. The 

35 output of key generator 213 is provided to the symbol encoder 212. 
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5 [0027] From each encoding key I provided by key generator 213, encoder 212 

generates an output symbol, with a value B(I), from the input symbols provided by the 
input symbol generator. The value of each output symbol is generated based on its 
key and on some function of one or more of the input symbols, referred to as the 
output symbol's "associated input symbols." The selection of the function (the "value 

10 function") and the associates is done according to a process described in Luby I. 

Typically, but not always, M is the same for input symbols and output symbols, i.e., 
they both code for the same number of bits. In some embodiments, the number K of 
input symbols is used by the encoder to select the associates. If K is not known in 
advance, such as where the input is a streaming file, K can be just an estimate. The 

15 value K might also be used by symbol encoder 212 to allocate storage for input 
symbols. 

[0028] The protocol converter 220 receives the output symbols and keys, and 
formats each to the protocol appropriate for the particular broadcast system. 
Exemplary broadcast protocols include TCP/IP, UDP/IP, MPEG, Digital Video 
20 Broadcast, satellite radio, terrestrial digital radio, as well as other network and/or 

broadcasting system protocols. In alternative embodiments of the transmitter 1 10 in 
which the protocol of the output symbols and keys do not require reformatting, the 
protocol converter 220 is omitted or bypassed. 

[0029] The output symbols and keys are next supplied to the transmit module 230. 

25 The transmit module operates to broadcast the output symbols over the primary and/or 
secondary channels 120 and/or 140, and depending on the keying method used, the 
transmit module 230 might also transmit some data about the keys of the transmitted 
output symbols. The transmit module 230 can be any suitable hardware components, 
software components, physical media, or any combination thereof, so long as it is 

30 adapted to transmit output symbols and associated key information. The transmit 
module may comprise, for example, a multiplexer or a modulator operable to 
modulate the output symbols and key data onto a carrier signal, front-end electronics 
to condition the carrier signal as needed, and a signal transmission means, e.g., an 
antenna, optical lens/telescope, cable modem, network interface card, 802.1 lx radio 

35 card, or other similar devices to transmit the carrier signal, said carrier signal 

comprising the coded transmission. Any particular modulation format may be used, 
for instance, OFDM (orthogonal frequency division multiplexing), coded OFDM, 
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5 QAM (quadrature amplitude modulation), CDMA (code division multiple access), 
QPSK (quadrature phase shift keying), and the like. 

[0030] Fig. 2B illustrates a method of converting input symbols into a coded 
transmission using the single-stage transmitter 110 shown in Fig. 2 A in accordance 
with one embodiment of the present invention. Initially at 242, the source data is 

10 arranged in an order set of input symbols, a process that is performed by the input 

symbol generator 21 1 in one embodiment. Subsequently at 244, a plurality of output 
symbols B(Io), B(Ii), etc. are generated from the ordered set of input symbols IS(0), 
IS(1), etc., using the above-described symbol encoder 212, key generator 213, counter 
214, stream identifier 215, and random number generator 216. In one embodiment, 

15 the output symbols are generated as a function of the input symbols IS(0), IS(1), etc. 
and corresponding encoding keys Io, Ii, etc. In one embodiment, the function is an 
exclusive-or (XOR) operation, although any arithmetic function may be used in the 
alternative. Preferably, the number of output symbols is much larger than the number 
of input symbols in the ordered set. More preferably, at least one output symbol is 

20 generated from more than one, but fewer than all of the input symbols in the ordered 
set. 

[003 1] Next at 246, the plurality of output symbols is broadcast over a transmission 
channel (primary and/or secondary channels 120 and/or 140). In the preferred 
embodiment, the transmitted output symbols are decodable into the order set of input 
25 symbols when the quantity N of the transmitted output symbols are received, where N 
is greater than one, but much less than the number of possible output symbols. 

[0032] Fig. 3 A illustrates a second embodiment of the transmitter 1 10 comprising a 
multistage information additive code transmitter in accordance with the present 
invention. Multistage encoding is particularly useful in the when the recipient joins or 
30 leaves the broadcast at times other then the commencement or termination of the 
broadcast. This scenario occurs frequently in broadcast applications, making the 
present invention particularly useful. 

[0033] Multistage transmitter 110 of Fig. 3A is constructed similarly to the single- 
stage transmitter illustrated in Fig. 2 A above, and includes a multistage encoder 310, a 
35 protocol converter 320 and a transmit module 330. The protocol converter 320 and 
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5 transmit module 330 operate in the manner as described above in Fig. 2A. The 

multistage encoder 310 employs a two-stage coding scheme as described in Raptor. 

[0034] During encoder operation, source data 105 is provided to the input symbol 
generator 31 1 which, in response, produces an ordered sequence of one or more input 
symbols IS(0), IS(1), IS(Q), . . . , each input symbol having a value and a position in 

10 the manner as described in Fig. 2 A. The static key generator 313 produces the stream 
of static encoding keys in response to a seed value supplied to it by the random 
number generator 315. The dynamic key generator generates a dynamic encoding key 
for each output symbol to be generated. Preferably, each dynamic encoding key is 
generated so that a large fraction of the dynamic keys for the same input file are 

15 unique. 

[0035] The symbol encoder 312 receives the ordered sequence of input symbols 
IS(0), IS(1), etc., a stream of static keys S 0 , Si, etc., and a stream of dynamic keys Io, 
Ii, etc, producing, in response, respective output symbols B(Io), B(Ii), etc. The value 
of each output symbol is generated based on its key, on some function of one or more 

20 of the input symbols, and possibly on one or more redundant symbols that had been 
computed from the input symbols. The collection of input symbols and redundant 
symbols which are correlated to a specific output symbol are referred to as being 
associated with that output symbol. In some embodiments, the number of K input 
symbols is used by the symbol encoder 312 to select the associated input symbols. If 

25 K is not known in advance, such as where the input is a streaming file, K can be 

estimated. The value of K may be used by the symbol encoder 312 to allocate storage 
for input symbols and any intermediate symbols generated by the symbol encoder 
312. 

[0036] Fig. 3B illustrates one embodiment of the symbol encoder 312 in accordance 
30 with the invention. The symbol encoder 312 includes a static encoder 312a, a 
dynamic encoder 312b, and a redundancy calculator 312c. The static encoder 
receives the sequence of input symbols IS(0), IS(1), etc., the number of K input 
symbols, a respective sequence of static keys So, Si, etc., and a number R of 
redundant symbols. Responsive to these inputs, static encoder 312a generates a 
35 respective sequence of R redundant symbols RE(0), RE(1), etc. In some 

embodiments, the redundant symbols generated by the static encoder 312a are stored 
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5 in an input buffer 3 12d. Input symbol buffer 3 12d may be only logical, i.e., the file 
may be physically stored in one place and the positions of the input symbols within 
the symbol buffer 31 2d could be only renamings of the positions of these symbols 
within the original file. 

[0037] The dynamic encoder 312b receives the sequence of input symbols IS(0), 
10 IS(1), etc., dynamic encoding keys I 0 , Ii, etc., and the sequence of redundant symbols 
RE(0), RE(1), etc. and, in response, generates the output symbols B(Io), B(Ii), etc. In 
the embodiment in which the redundant symbols are stored in the input symbol buffer 
31 2d, the dynamic encoder 312b receives the input symbols and redundant symbols 
from the input buffer 31 2d. The redundancy calculator 312c is operable to compute 
15 the number R of redundant symbols from the number K of input symbols, a process 
which is further described in the Raptor reference incorporated herein. 

[0038] Fig. 3C illustrates a method of converting input symbols into a coded 
transmission using the multistage transmitter 110 shown in Fig. 3 A in accordance 
with the present invention. Initially at 342, the source data is arranged in an order set 

20 of input symbols IS(0), IS(1), etc., a process that is performed by the input symbol 
generator 31 1 in one embodiment. Subsequently at 344, a plurality of redundant 
symbols RE(0), RE(1), etc. is generated as a function of input symbols IS(0), IS(1), 
etc. and corresponding static keys So, Si, etc., as described in Fig. 3B. Next at 346, a 
plurality of output symbols B(Io), B(Ii), etc. is generated from a combined set of the 

25 input symbols IS(0), IS(1), etc. and the redundant symbols RE(0), RE(1), etc., and the 
output symbols broadcast over a transmission channel (primary and/or secondary 
channels 120 and/or 140). In the preferred embodiment, the number of output 
symbols is much greater than the number of symbols in the combined set of input and 
redundant symbols. More preferably, at least one output symbol is generated from 

30 more than one, but fewer than all of the combined symbols. 

[0039] The above-described encoders 210 and 310, protocol converters 220 and 
320, and transmit modules 230 and 330 may individually be realized in a variety of 
forms, such as in hardware, in software/firmware, or a combination of these 
components. When partially or entirely implemented in software or firmware, the 
35 required functionality may be provided by instruction code which controls a 

computer, microprocessor, or other programmable system to perform the described 
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5 processes. In such embodiments, the instruction code may be stored on a readable 
medium such as a hard drive, other disk, microprocessor memory, or other such 
device that is suitable to store the instruction code. Further, encoders 210 and 310, 
protocol converters 220 and 320, and transmit modules 230 and 330 may be 
collectively integrated in varying degrees, depending upon the particular application. 

10 For example in a satellite broadcast application, the multistage encoder, protocol 
converter (if employed), and transmit module may be located within a single 
appliance at the satellite ground station and/or on-board a spacecraft transceiver. In 
another embodiment, the encoder and transmit module may be separately located. 
Those skilled in the art will appreciate integrated systems of varying configurations 

1 5 are envisioned under the present invention. 

[0040] The foregoing are only exemplary of the systems and methods for generating 
and transmitting information additive coded data. Further embodiments are described 
in Raptor and Luby I. 

Pre-Encoding Data Segmenting and Loading 
20 [0041] In some embodiments of the present invention, the process of broadcasting 
data from a transmitter to one or more receivers using information additive codes in 
accordance with the present invention is subdivided into several subprocesses 
generally defined as an upload phase, a preparation phase, a transmission phase, a 
decoding phase, and a storage phase. 

25 [0042] The upload phase is the period in which the data is uploaded onto the 
encoding server. The encoding server can be any device capable of storing an 
appropriate amount of data, performing computations on the stored data, and sending 
the data to one or more clients. In some applications, the upload phase of the data 
may be negligible, for example when the data is directly created on the transmitting 

30 server. In other applications, the upload phase may be substantial, for example when 
the data is created and stored on an external storage device and has to be transported 
to the transmitting server. 

[0043] Once the upload phase is completed, the data may need to be prepared for 
encoding. For example, when an information additive coding system as described in 
35 Raptor is used, it may be desirable to preprocess the data and compute static encoding 
symbols before the transmission commences. Where traditional FEC schemes are 
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5 used, it may sometimes be desirable to compute a part, or all of the encoding symbols 
before they are transmitted. The phase between the completion of the upload and the 
commencement of the transmission is referred to as the preparation phase. 

[0044] The transmission phase is the period in which encoding symbols are 
transmitted to the recipient(s). In some cases, encoding may continue during the 
10 transmission phase. For example, this could be the case when information additive 
codes are used. The encoding symbols may be transmitted using the User Datagram 
Protocol (UDP) via unicast, or multicast, if applicable. 

[0045] Decoding of the received information may be triggered if some or all of the 
required number of encoding symbols are received by the client. For example, where 

1 5 information additive coding is used as explained in Luby I or Raptor, the decoding 
may be triggered when an amount of encoding symbols is received that is slightly 
larger than the original amount. In other embodiments the decoding may be triggered 
when a substantially smaller amount of encoding symbols are received. The decoding 
phase is the period between the commencement of the decoding procedure and the 

20 complete recovery of the data, in case of successful decoding, or, if decoding is not 
possible, an indication that decoding is not possible and termination of the decoding 
process. 

[0046] Once decoding is complete, the data may be stored on a storage device 
which may be remotely located from the client. For example, the data can be stored 
25 on a shared data server so it can be commonly used by a number of users. In that 
case, the decoded data is transferred to the storage device. The storage phase is the 
period between the termination of the decoding process, and the commencement of 
the storage process on an external storage device. 

[0047] The upload, preparation, decoding, and storage phase of a data transmission 
30 scheme using some form of information additive coding may increase the total 

transmission time. The time needed for each of these steps may depend substantially 
on the size of each encoding section (an encoding section is a piece of the data that is 
being encoded). In some applications, this piece can be the entire data. In other 
applications, the piece may be substantially smaller. 

35 [0048] The time added to the raw transmission time by the phases of upload, 

preparation, decoding, and storage can be a small fraction of the total transmission 
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5 time. This is true, for example, where the link between the server and the client 
admits only low speeds, whereas the link between the storage device and the 
transmission server as well as the link between the client and the final storage device 
for the data is very fast, and the computing resources on the transmission server and 
the client allow for very fast preparation and decoding. 

10 [0049] In some cases the additional time spent for upload, preparation, decoding, 
and storage make up a substantial fraction of the total transmission time. For 
example, in a transmission scenario where the data to be transmitted resides on a 
server different from the transmission server, and the link between the transmission 
server and the storage server is a 100 megabit per second (Mbps) link, then the upload 

15 time for a file of size 500 megabytes (MB) is 40 seconds. If the speed of the 
preparation phase is also 100 Mbps, then the preparation phase also requires 40 
seconds. If the link between the transmitting server and the client admits a 
transmission rate of 50 Mbps, and the data is sent to the client via UDP without 
employing rate control, then the transmission time of the file is at least 80/(1 -p) 

20 seconds, wherein p is a real number between 0 and 1 indicating the percentage of 

symbols lost during transmission. For example, if p is 1%, then the transmission time 
is at least 80.81 seconds. If the speed of the decoding is also 100 Mbps, then the 
decoding step requires 40 seconds as well. Assuming that the client may be able to 
transmit the decoded file to the external storage device at a speed of 100 Mbps, the 

25 storage phase adds an additional 40 seconds to the transmission time. If encoding is 
not performed substantially concurrently with the uploading, decoding is not 
performed substantially concurrently with the reception, and storage is not performed 
substantially concurrently with the decoding, then the various phases of the 
transmission add up to 240.81 seconds, of which only 80.81 seconds is the real 

30 transmission. The raw transmission time is increased by a factor of almost 3. Thus, 
in some embodiments of the invention, a system and process is useful in reducing the 
aforementioned upload, preparation, decoding, and storage processes. 

[0050] Fig. 4A illustrates a simplified block diagram of an improved encoder 400 in 
accordance with one embodiment of the present invention. The improved encoder 
35 400 includes a control unit 402, a cache unit 410 and an encoding engine previously 
described as the single or multistage encoders 210 or 310, respectively. 
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5 [005 1 ] The cache unit 4 1 0 is operable to retrieve parts of the data 1 05 and provide it 
to the encoding engine 210/310 for encoding. The size of the parts retrieved 
constitutes the size of a section encoded by the encoding engine, and may be 
communicated to the control unit 402 which forwards the information to the client via 
the out-of-band communication. 

10 [0052] In one embodiment, encoding is performed on a part of the data 105, while 
another part is retrieved into cache unit 410. Various types of resources needed for 
performing the encoding scale with the size of the encoding section. Such resources 
may include computational resources, and memory resources. By reducing the size of 
each encoding section, the total demand for resources on the server decreases. 

1 5 [0053] Fig. 4B illustrates a first embodiment of the improved encoder 400 in 

accordance with the present invention, with previously identified features retaining 
their reference numerals. As shown, the cache unit 410 includes an upload unit 412, 
and two data buffers 414 and 416, the size of which is chosen so that each holds two 
consecutive segments S(n) and S(n+1) of the data 105. Those skilled in the art will 

20 appreciate that any number and/or size of buffers may be chosen in other 
embodiments of the invention. 

[0054] During operation, the data file or stream is subdivided into sections S(l), 
S(2), etc. If data 105 refers to a stream, not all of the sections may be available at the 
time of transmission. In the following descriptions of whether an operation is 
25 performed on a section, it is implicitly assumed that the section is available at the time 
when the operation is performed. If not, the operation will wait for the section to 
become available. 

[0055] In one embodiment the sizes of all sections, except possibly the last, are 
equal. In another embodiment, the sizes of the different section may be substantially 

30 different. In one embodiment, the size of each section can be computed by the upload 
unit 412 and communicated to the control unit 402 and the encoding engine 210/310. 
In another embodiment the size of the sections can be selected by the operator and 
communicated to the control unit 402 and encoding engine 210/310. In another 
embodiment, the size of the sections can be selected by the operator and 

35 communicated to cache unit 810, for example via an application program interface 
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5 (API). In yet another embodiment, the control unit 402 computes the sections sizes 
and communicates it to the upload unit 412, and the encoding engine 210/310. 

[0056] After determining the size of each section, the upload unit 412 retrieves the 
first section S(l) of the data 105 and stores it in the buffer 416. Once storage is 
complete, that section is forwarded to the encoding engine 210/310 for encoding. At 

10 the same time, the next section S(2) is retrieved and put into the buffer 414. The 
encoding engine 210/310 generates encoded data for the first section. It may 
terminate the process when instructed by the control unit 402. The same termination 
message may also be sent to the upload unit 412. At this point, the upload unit 412 
may forward the contents of buffer 414 to the encoding engine, retrieve section S(3) 

15 from the data 105, and put it into buffer 416. The encoding engine continues 

generating encoded data for S(2) until instructed by the control unit 402 to stop. In 
general, once the encoding engine 210/310 and upload unit 412 receive an instruction 
from the control unit 402 to terminate encoding section S(n-l), section S(n) is 
forwarded to the encoding engine and section S(n+1) is retrieved from data 105 and 

20 buffered. The process may continue indefinitely, or until upload unit 412 is instructed 
by the operator or other external signal to stop, or continue until all of the data 105 
has been transmitted. 

[0057] In one embodiment in which the recipient wishes to receive only parts of the 
data 105 exactly, some sections of data 105 may be transmitted without coding, while 
25 others may be coded. For example, where data 105 corresponds to a live stream, and 
the source coding method used for digitization allows for layering the data into parts 
of various levels/sections, such an embodiment could be used to encode some 
levels/sections while sending other levels/sections without coding. 

[0058] Fig. 4C illustrates a second embodiment of the improved encoder 400, 
30 comprising a multiple engine encoder. The multiple-engine encoder 400 is comprised 
of two engines El and E2, embodiments of which are described in Figs. 2 A and 3 A 
above. While two encoding engines are shown, a larger number of engines may be 
used in alternative embodiments under the present invention. 

[0059] Upon initiating a download, the cache unit 410 fetches the first section S(l) 
35 and forwards it to encoding engine El for encoding. At the same time, it fetches S(2), 
and forwards it to encoding engine E2 for preparation of encoding. Encoding engine 
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5 E2 could also start encoding section S(2) and storing encoding information into a 
buffer for future transmission. Once the 'done message' for section S(l) is received 
by control unit 402, it may instruct the encoding engine El and the upload unit 412 to 
drop Section S(l). Upon receiving this request, the upload unit 412 instructs E2 to 
start encoding section S(2); alternatively, if encoding information has already been 

10 generated, it could be supplied to the protocol converter (if required) and 

subsequently to the transmit module . At the same time, section S(3) is fetched from 
data 105, stored in buffer 415, and forwarded to encoding engine E2. Similarly, 
encoding engine E2 prepares section S(3) for encoding, or, in case of availability of 
memory, starts encoding section S(3) and storing encoding information into a buffer 

15 for future transmission. In general, encoding engine E2 encodes sections with an 
even index 2n, and encoding engine El encodes sections with an odd index 2n+l, 
wherein n is an integer greater than or equal to 1. Once section S(2n-1) is finished, 
encoding engine E2 starts encoding section S(2n), and the upload unit 412 fetches 
section S(2n+1) (if it exists) and forwards it to encoding engine El for preparation for 

20 encoding. Similarly, once section S(2n) is finished, encoding engine El starts 

encoding section S(2n+1), and the cache unit fetches section S(2n+2) and forwards it 
to encoding engine E2 for preparation for encoding. 

[0060] The foregoing example is for illustrative purposes only, and additional 
buffers may be used in alternative embodiments under the present invention. For 
25 example, in the case of three buffers, the first one would be used to produce encoding 
symbols for section S(3n-2), while the second one would be used to prepare section 
S(3n-1) for encoding, and at the same time, section S(3n) would be uploaded into the 
third data buffer. The larger number of buffers may lead to a further decrease of 
upload, preparation, and decoding times. 

30 [0061] As mentioned above, the size of the sections S(l), S(2), . . . depends on a 

number of parameters. On the one hand, the sections chosen should not be too small, 
since this may lead to inefficiencies in the transmission. For example, where the 
channel has a round trip time (RTT) of 250 milliseconds (ms), each section is served 
for 250 ms longer than is needed. If the channel has a bandwidth of 10 Mbps, then 

35 this translates to 320 kilobytes (KB). If the section size is less than this amount, then 
at least 50% of the bandwidth in channel 155 is wasted. To keep the wasted 
bandwidth at 1% or less, the section size needs to be more than 3 1 megabytes (MB). 
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5 [0062] In some embodiments of the present invention, the delay incurred by late 
reception of the 'done message' may be substantially reduced by transmitting a 
section at a rate that varies over time. The exact variation of the transmission rates 
depends on the application. In one embodiment, the rate at which the first section is 
served could decrease over time, and at the same time, the rate at which the second 
10 section is transmitted is increased over time. Once the 'done message' for the first 

section is received, the first section is dropped and the process continues with sections 
2 and 3, and so forth. The number of sections served substantially concurrently is not 
limited by two, but could take on any value, as long as the resources on the server 
would allow that. 

1 5 [0063] Although very small section sizes may lead to transmission inefficiencies, 
sections of too large a size could lead to a waste of server and client resources, and 
could add an additional delay to the transmission. For example, suppose that the data 
transmitted is data of size 500 MB, that the section size is 50 MB, that the connection 
between a server and a storage device storing the data has a bandwidth of 100 Mbps, 

20 that the preparation speed for the section is also 100 Mbps, and that the connection 
between client and the storage device storing the data has a bandwidth of 100 Mbps. 
Then the total transmission time for the data is equal to the time to upload, prepare, 
decode, and store one section, plus the time needed for the transmission of the entire 
data. With 1% loss, the latter equals 80.81 seconds, and the former equals 16 

25 seconds, leading to a total transmission time of 96.81 seconds. If the section size is 
100 MB, then the delay caused by uploading, preparing, decoding, and storing a 
section is proportionally larger and equal to 32 seconds, leading to a total transmission 
time of 1 12.81 seconds. 

[0064] Large sections could also add to the amount of memory used by the server 
30 and by the client. For reasons of speed, it is advantageous to perform the encoding 
and decoding operations in the Random Access Memory (RAM) or other fast access 
memory devices on the server and on the client, rather than reading from and writing 
to disk. In such an embodiment, the server and the client preferably include enough 
memory to store at least the amount of two sections. To keep the memory resources 
35 low, the section sizes need thus to be chosen appropriately. 
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5 [0065] Various methods can be used to decrease the memory requirements on the 
server and on the client. On the client side one embodiment of such a method is the 
following: while decoding the section S(n-l), the space freed by the decoded content 
is used to store incoming encoded information about section S(n). Under favorable 
conditions with respect to the decoding speed and the transmission speed, the memory 
10 requirement for the client side can be decreased by a factor of 2. Other methods using 
sophisticated interleaving techniques similar to those described in Rasmussen can be 
employed to reduce the memory requirements on the server and the client side, as will 
be apparent to those skilled in the art upon studying Rasmussen document and its 
references. 

1 5 [0066] In one embodiment of the present application the section sizes are chosen to 
have different sizes. For example, where the server can upload data faster than it can 
transmit, it is possible to use section sizes that grow over time to facilitate faster start 
up times on the server. For example, the methods provided in MOD may be used to 
compute various section sizes and scheduling algorithms for their activation. The 

20 different section sizes can also be used to support multiple clients that experience 
different fractions of losses. For example, recipients could select which sections to 
receive in a similar way as described in MOD, except that only a limited number of 
sections are serving at the same time. Then the fact that the section sizes are growing 
improves the chances that multiple recipients receive concurrently from the same 

25 sections towards the end of the transmission. In particular, in a configuration where 
the recipients start receiving at the same time, if recipients have a maximum loss rate, 
then the section size growth can be calculated to ensure that at any point in time only 
a small number of sections need to be served concurrently. 

[0067] For example, in a case where the next section size is a factor of a larger than 
30 the previous one, with a being a real number larger than or equal to one, and where 
each client experiences a maximum loss rate of 20%, then if a is chosen to be at least 
1.25, and the sections are transmitted using a chain reaction coding system or a 
traditional FEC code with a rate of at most 0.8, and where the clients commence the 
download at the same time, then it can be shown that the server needs to broadcast 
35 only two sections at a time to ensure that all clients receive the entire content. The 

results of MOD can be used to obtain good sectioning schemes in scenarios where the 
server resources or the client resources, e.g., memory or CPU speed, are constrained. 
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5 Post-Encoding Processes 

[0068] In applications where the transmission and delivery of a live data stream is 
desired, the aforementioned encoding processes may be modified or augmented in 
order to reduce latency in the coding and decoding processes. Specific systems and 
methods for reducing latency are described in Rasmussen. 

10 [0069] Fig. 5 A illustrates a general encoding process which may be used in system 
broadcasting live streaming data. Initially, the live data stream is partitioned into 
time-ordered segments So, Si, S2, with common duration t seconds and common 
length K AMBs. (The live data stream may not naturally be in the same format as the 
transmission medium, but we may use the same units without loss of generality.) The 

15 data partitioning may include those processes described in Figs. 8A-C below. 

[0070] Subsequently, an FEC (forward error/erasure correction) code, such as 
information additive coding, is applied separately to each Si, the output of the code 
denoted Ei. Each Ei has length N AMBs. The N AMBs for E 0 are transmitted on the 
medium, followed by the N AMBs for Ei, etc. At the time when segment Si is to be 

20 recovered, some fraction of the AMBs of Ei are available. The FEC code guarantees 
that if L of the AMBs are available, Si can be recovered. The value of L is a property 
of the particular coding employed. Reed-Solomon codes have the desirable property 
that L = K; however, the complexity of decoding necessitates small values for K and 
N. Information additive codes as described in Luby I and Raptor have L slightly 

25 larger than K and low complexity of decoding. 

[0071] Fig. 5B illustrates a specific embodiment for encoding the process for a live 
data stream in accordance with the present invention. The process begins at 571, 
when the first segment So containing first segment data is received. Next at 572, a 
forward error correction algorithm is applied to the first segment data to produce a 

30 first transmit block T 0 containing the FEC-encoded first segment data. In a specific 
embodiment, the FEC employed is information additive codes, as described and 
incorporated herein. In the signal timing diagram of Fig. 5C, the applied forward 
error correction coding outputs the FEC-encoded segment data after all of the first 
segment data is received. In an alternative embodiment, the FEC-encoded data is 

35 produced as the segment data is being received. 
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5 [0072] At 573, first transmit block T 0 is subdivided into two or more blocks. In the 
exemplary embodiment of Fig. 5C, the first transmit block T 0 is subdivided into three 
blocks T 0a , T 0 b, and T 0c . In the preferred embodiment, subblocks T 0a , T 0 b, and T 0c 
each comprise distinct data, i.e., they contain minimal, if any, common data. Next at 
574, a first of the two or more subblocks is transmitted on a first main subchannel. As 
10 shown in Fig. 5C, the first subblock T 0a is transmitted on a first main subchannel 
506Mi. 

[0073] Next at 575, the second segment Sicontaining first segment data is received. 
A forward error correction algorithm is subsequently applied to the second segment 
data to produce a first transmit block Ti containing the FEC-encoded second segment 
15 data (process 576). At 577, the second transmit block Ti is subdivided into two or 
more blocks, which, in Fig. 5C comprises three blocks Ti a , Ti b , and Ti c . As above, 
subblocks Tia, Ti b , and T !c each preferably comprise distinct data. 

[0074] At 578, the second subblock T 0 b is transmitted on the first main subchannel 
506Mi substantially concurrent with the transmission of the first subblock Ti a on the 
20 second main subchannel 506M 2 . At 579, there is the concurrent transmission of Tu 
on the first booster subchannel 506Bi and T 0a on the second booster subchannel 
506B 2 . 

[0075] As the signal timing diagram of Fig. 5C illustrates, the aforementioned 
process may be repeated for additionally received segments S2-S7, in which each 
25 segment is received, forward error corrected to a transmit block T2-7, each transmit 
block divided into two or more subblocks, and the subblocks transmitted on the main 
and booster subchannels as shown. In the preferred embodiment, the number of 
subdivided blocks determines the number of receiver and booster subchannels, the 
total bandwidth of which equals the reception rate 509. 

30 [0076] In the particular embodiment of Fig. 5C, a first subblock sequence, T ia , i.e., 
Tu, T 2a , T 3a , . . . is transmitted along the first booster subchannel 506Bi. As further 
illustrated, the first subblock transmit sequence one block delayed, i.e., T 0a , Ti a , T 2a , 
T3 a , . . . is transmitted along the second booster subchannel 506B 2 The third booster 
channel 5O6B3 transmits a second subblock sequence T^, i.e., T Q b, Tib, T 2 b, T 3 b , . . . 

35 A receiver in the system may have sufficient bandwidth to simultaneously monitor 
both the main channel 506M and the booster channel 506B. In another embodiment, 
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5 the receiver channel is limited, for example, by its particular design, by network 
congestion, or by signal interference to monitor only one channel. In the latter case, 
the receiver is preferably configured to monitor the booster channel 506B initially, 
and can switch its reception to receive transmit blocks Ti either on the booster channel 
506B or on the main channel 506M. 

10 [0077] During reception, the receiver listens to the booster channel 506B for the 
first transmit blocks, which comprises T 0a , T 0 b and Ti a in the time slot 554. The 
receiver subsequently switches to the main channel 506M to receive transmit blocks 
Toe, Tib, T 2a during the next transmit slot 555. The corresponding pieces of the 
received subdivided data are assembled, e.g., To c » Ti b & Ti c , T2a> .... and FEC- 

15 decoded to recover the corresponding segment data. As illustrated, transmissions 

over the first and second time slots 554 and 555 will result in two-thirds of the second 
transmit block Ti data being recovered (Ti a & Ti b ), which may be sufficient to 
recover the data contained within corresponding segment block Si. As the process 
continues in time slots 556 and beyond, the later-occurring transmit subblocks T 2 \ 9 T 3 i, 

20 etc. will be received, the transmit blocks T 2 , T 3 , etc. reconstructed, and the data 
contained within their corresponding segments S2, S3 recovered. 

[0078] The foregoing is only exemplary of the systems and methods for processing 
information additive codes for transmission and reception. Further embodiments are 
described in Rasmussen. 

25 Exemplary Broadcast Receivers and Processes 

[0079] Fig. 6A illustrates a first embodiment of the receiver 130, comprising a 
single-stage information additive code receiver in accordance with the present 
invention. The term "receiver" is used generically to refer to the unit's function, and 
may comprise a network client, computer peripheral, a radio, PCMCIA card, cable 

30 modem, satellite radio receiver, network device, a GPS-based car navigation receiver, 
set-top-box, home network gateway, or any such unit which is configured to receive 
and process the coded information as described herein. 

[0080] The receiver 130 functions complementarily to the single-stage transmitter 
of Fig. 2 A above and includes a receive module 610, a protocol converter 620, and a 
35 single-stage decoder 630. The receive module 610 is operable to receive the coded 
transmission 115 and recover therefrom the output symbols and, when present, data 
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5 about the transmitted keys. The receive module 610 comprises that hardware, 

software, firmware or a combination thereof needed to carry out these functions and 
may comprise, for example, a signal collection means (e.g., an antenna, optical 
lens/telescope, cable modem, network interface card, 802.1 lx radio card, etc.), front- 
end electronics, and a demodulator to recover the output symbols and key data. 

1 0 [008 1 ] The protocol converter 620 receives the output symbols and key data, and 
formats each to the protocol appropriate for the particular receiver system. 
Exemplary receiver protocols include TCP/IP, UDP/IP, MPEG2-TS, or other network 
or communication system protocols. In alternative embodiments in which the 
protocol of the recovered output symbols and key data do not require reformatting, the 

1 5 protocol converter 620 is omitted or bypassed. 

[0082] The single-stage decoder 630 and corresponding method of operation are 
generally as described in Luby I, the contents of which is incorporated by reference. 
As shown, a key regenerator 631 receives key data and regenerates the keys for the 
received output symbols. Symbol decoder 632 uses the keys provided by key 
20 regenerator 63 1 together with the corresponding output symbols, to recover the input 
symbols (i.e., IS(0), IS(I), IS(2), etc). Symbol decoder 632 provides the recovered 
input symbols to an input file reassembler 633, which generates a copy of input file or 
stream 105. 

[0083] Fig. 6B illustrates a method of recovering input symbols from a coded 
25 transmission using the receiver shown in Fig. 6A in accordance with one embodiment 
of the present invention. At 652, the receiver receives one or more output symbols, 
each output symbol being generated from one or more input symbols from an order 
set of input symbols. Preferably, at least one output symbol is generated from a set of 
at least two, but fewer than all of the input symbols in the ordered set of input 
30 symbols. More preferably as described above, the number of possible output symbols 
is much greater than the number of input symbols in the ordered set. At 654, the 
ordered set of input symbols is regenerated from a received set of N output symbols. 
Preferably, N is greater than one, but much smaller than the number of input symbols 
in the ordered set. 

35 [0084] Fig. 7A illustrates a second embodiment of the receiver 130 comprising a 
multistage information additive code receiver in accordance with the present 
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5 invention. The receiver 130 functions complementarity to the transmitter of Fig. 3 A 
and is constructed similarly to the single stage receiver illustrated in Fig. 4A above. 
The multistage receiver 130 similarly includes a receive module 710, a protocol 
converter 720, and a multistage decoder 730. The receive module 710 and protocol 
converter 720 operate in much the same manner as described above in Fig. 6A. The 
10 multistage decoder 730 employs a two-stage coding scheme as described in the 
Raptor, incorporated herein by reference. 

[0085] During decoder operation, key data information is provided to the dynamic 
key regenerator 731, which, in response, regenerates dynamic keys I a , lb, etc. The 
static key generator 733 produces static keys So, Si, etc. in response to a seed value 
15 supplied to it by the random number generator 734. Output symbols B(Iq), B(Ii), etc., 
dynamic keys I a , lb, etc., static keys S 0 , Si, etc., and values K and R are provided to 
the symbol decoder 732, which, in response, produces input symbols IS(0), IS(1), etc . 
The input symbols are supplied to a data reassembler 735 which substantially 
reconstructs a copy of the original data file or stream. 

20 [0086] Fig. 7B illustrates one embodiment of the symbol decoder 732 in accordance 
with the invention. The symbol decoder 732 includes a dynamic decoder 732a, a 
static decoder 732b, and a reconstruction buffer 732c. The dynamic decoder 732a 
receives the output symbols B(I a ), B(I b ), etc. and the dynamic keys I a , lb, etc. In 
response, the symbol decoder 732 attempts to reconstruct the input symbols IS(0)- 

25 IS(K-1) and redundant symbols RE(0)-RE(R-1). Input and redundant symbols 

recovered by the dynamic decoder 732a are stored in the reconstruction buffer 732c. 
Upon completion of dynamic decoding, the static decoder 732b attempts to recover 
any input symbols not recovered by the dynamic decoder 732a. In particular, the 
static decoder 732b receives input and redundant symbols from the reconstruction 

30 buffer 732c, and static keys So, Si, etc. from the static key generator. The recovered 
input symbols stored in the reconstruction buffer 732c are supplied to the input data 
assembler 735 (of Fig. 7 A). 

[0087] Fig. 7C illustrates a method of recovering input symbols from a coded 
transmission using the receiver shown in Fig. 7A in accordance with one embodiment 
35 of the present invention. At 752, the receiver receives one or more output symbols, 
each output symbol being generated from one or more symbols from a combined set 
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5 of input symbols and redundant symbols. Preferably, at least one output symbol is 
generated from a set of at least two, but fewer than all of the symbols in the combined 
set of input and redundant symbols. More preferably as described above, the number 
of possible output symbols is much greater than the number of symbols in the 
combined set of input and redundant symbols. At 754, at least a subset of the 

10 combined set of input and redundant symbols is regenerated from a received set of N 
output symbols, whereby the combined set includes regenerated input symbols and 
regenerated redundant symbols. At 756, some of the unregenerated input symbols 
may be regenerated from regenerated redundant and input symbols if the previous 
step 754 does not result in the regeneration of the input symbols to a predefined 

1 5 degree of accuracy. 

[0088] As described above with respect to the broadcast transmitter embodiments, 
the receive modules, protocol converters, and decoders may be individually realized 
in a variety of forms, such as in hardware, in software/firmware, or a combination of 
these components and in varying degrees of integration, depending upon the particular 
20 application. 

[0089] The foregoing are only exemplary of the systems and methods for receiving 
and decoding information additive coded data. Further embodiments are described in 
Raptor. 

Inactivation Decoding 

25 [0090] In one embodiment of the receiver's decoding processing, decoding starts by 
identifying an "output symbol of degree one." The term "output symbol of degree 
one" refers to an output symbol associated with only one source (i.e., input) symbol. 
Similarly, an output symbol associated with two source symbols would be referred to 
as an output symbol of "degree two." Source symbols are referred to in a similar 

30 manner corresponding to the number of output symbols each source symbol is 

associated with. An output symbol and an input symbol are described as "associated" 
if the value of the input symbol is used to obtain the value of the output symbol. The 
mathematical operation which defines this association may be any particular 
operation, and in one embodiment, the output symbol's value is the XOR of the 

35 values of some of the source symbols. 
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5 [0091] Once the output symbol of degree one is identified, the associated source 
symbol is recovered and is removed from the decoding process. The process 
continues by identifying another output symbol of degree one. The process is 
continued until all the source symbols are recovered, or until there is no output 
symbol of degree one. 

10 [0092] This decoding process may encounter difficulty when no output symbol of 
degree one is found. In some instances, the decoding process may stop prematurely 
and the decoder may flag an error. Alternatively, the decoder may use other more 
elaborate algorithms like Gaussian elimination to complete decoding, if possible. 
However, the running time of Gaussian elimination may be prohibitively long for 

1 5 applications where fast decoding is desired, especially when the number of 

unrecovered input symbols at the time when no more output symbols of degree one 
are found is large. This would lead to a decoding algorithm whose computational 
overhead is substantially larger than the information additive decoder, and may 
therefore be undesirable in certain applications. 

20 [0093] Fig. 8 A illustrates a method for decoding the information additive codes 

using inactivation in accordance with one embodiment of the present invention. The 
processes included in the exemplary decoding routine 800 include a start-up process 
810, a source symbol selection and deactivation process 820, and a source (i.e., input) 
symbol value recovery process 830. These processes are described in greater detail in 

25 Shokrollahi. 

[0094] Fig. 8B illustrates one embodiment of the start-up process 810 illustrated in 
Fig. 8 A. Initially at 81 1, a determination is made whether any output symbols of 
degree one are present. If so, the source (i.e., input) symbol associated with the 
output symbol is recovered at 812. The process then returns to 81 1, where a 
30 subsequent determination is made whether any other output symbols of degree one 
remain in the code. If at 81 1 no output symbols of degree one remain, the process 
proceeds to the source symbol selection and deactivation process 820. 

[0095] Fig. 8C illustrates one embodiment of the source symbol selection and 
deactivation process 820 illustrated in Fig. 8 A. Initially at 821, an active source 
35 symbol is selected which is associated with an output symbol of degree two or higher 
(i.e., an output symbol associated with two or more source symbols). The manner by 
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5 which a particular source symbol is selected from among a number of similar source 
symbols is described in Shokrollahi. Next at 822, the particular source symbol 
selected is deactivated. Subsequently at 823, a determination is made whether any 
output symbols of degree one exist for decoding. In some embodiments, the 
preceding deactivation will produce one or more output symbols of degree one. In 
10 other embodiments, the preceding deactivation will not result in an output symbol of 
degree one. In the latter case, the process repeats the steps of 821-823. 

[0096] If the deactivation process of 822 does result in the production of one or 
more output symbols of degree one, the process continues at 824 where one of the 
source symbols associated with an output symbol of degree one is declared 
15 recoverable. The process then returns to 823 where a determination is made whether 
any additional output symbols of degree one remain. The processes of 823 and 824 
are repeated until all of the output symbols of degree one produced by the preceding 
deactivation process are declared recoverable. 

[0097] If the deactivation of the selected source symbol at 822 does not result in the 
20 an output symbol of degree one, or once all of the output symbols of degree one are 
declared recoverable at 824, the process continues from 823 to 825, where a 
determination is made whether any source symbols associated with output symbols of 
degree two or higher remain. If so, the process returns to 821 where another active 
source symbol of degree two or higher is selected, deactivated, and the presence of 
25 output symbols of degree one is checked. One or more iterations of the processes 

may occur, for instance, where the deactivation of a first source symbol of degree two 
or higher does not result in an output symbol of degree one, but additional source 
symbols of degree two (or higher) remain. In this case, the subsequent deactivation of 
another source symbol of degree two (or higher) may produce one or more output 
"30 symbols of degree one. The process repeats until all source symbols have been either 
been recovered (via the start-up process 810), deactivated (via 822), or declared 
recoverable (via 825), at which point the process proceeds to the source symbol value 
recovery process 830. 

[0098] Fig. 8D illustrates one embodiment of the source symbol recovery process 
35 830 illustrated in Fig. 8A. Initially at 832, the values of one or more source symbols 
deactivated in 822 are recovered. In a specific embodiment, for instance in which 
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5 Gaussian elimination is used in the decoding process, all values of deactivated source 
symbols are recovered in this process. Subsequently at 834, the values of one or more 
source symbols declared recoverable in process 825 are determined using the 
recovered values of the deactivated source symbols. In one implementation, such as 
the aforementioned process in which Gaussian elimination is used, the values of all 
10 recoverable source symbols are determined. In alternative embodiments of 832 and 
834, the values of one or more, but fewer than all of the recoverable source symbols 
are determined. This may be advantageous when, for reasons of necessity, 
expediency, cost, etc., a complete decoding of the information additive code is not 
required or possible. 

1 5 [0099] The foregoing is only exemplary of the systems and methods for decoding 
information additive codes through deactivation. Further embodiments are described 
in Shokrollahi. 

Announcement and Previous Program Channels 

[0100] In a particular embodiment of the invention, receivers are informed about 
20 future broadcast transmissions by session description data. Session description data 
may include a description of the upcoming transmission, the expected day/time of the 
transmission, and file size of the transmission. The session description data may be 
communicated on a dedicated announcement channel within the broadcast system (for 
example, the secondary channel or a channel similar thereto), or it may be 
25 multiplexed with the source data along the primary channel. 

[0101] In another embodiment, source data belonging to a previous data file/stream 
is broadcast in order to allow those receivers which did not obtain the threshold 
quantity of coded transmission to recover the previous data file/stream. Coded 
transmissions corresponding to a previous program may be broadcast on a separate 
30 channel (perhaps at a low data rate so as not to too greatly reduce the data rate of the 
primary and/or announcement channels), or it may be multiplexed with the source 
and/or announcement data. 

Exemplary Applications and Systems 

[0102] As noted above, the properties of the information additive codes are ideally 
35 suited for many broadcast applications, the requirements of which have been only 
minimally met by present day systems. Conventional broadcast systems which 
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5 disseminate large data files using a data carousel protocol suffer from protracted 

transmission periods, as signal transmission must be repeated until a high probability 
exists that most terminals have received each specific segment of data. When it is 
considered that the receiving terminal may be intermittently available (e.g., a car 
which stops receiving when the ignition is switched off, or which looses signal 
10 reception within a tunnel), an even longer broadcast period must be undertaken. 

[0103] Broadcast systems employing information additive coding avoids these 
shortcomings, as one of the code's properties is that only a threshold quantity of code 
segments need be decoded in order to recover the entire encoded file. The receiving 
terminal need only receive a particular threshold amount of data to recover the file, 
15 and data received during any reception period will contribute toward that threshold. 
As a result, broadcast time to these terminals is substantially reduced. 

Solution for Broadcasting to Automobiles 

[0104] Current in-car global positioning satellite (GPS) systems combine satellite 
positioning information with a DVD-based database. These databases include maps, 

20 routing information, and Point-of-Interest (POI) information data, including retail and 
services information, for example. Updates on routing and POI information must be 
constantly communicated to drivers if the navigational system is to be relied upon. 
Further, in-car navigation systems represent a primary platform for receiving large 
information and entertainment files such as current weather reports, audible books, 

25 movies, or information useful for the driver and passengers. Accordingly, in-car 
navigation systems operable to support these services would provide substantial 
value. 

[0105] Fig. 9A illustrates one embodiment of the present invention comprising a 
satellite system 900 for broadcasting data, such as the aforementioned data and/or 

30 entertainment services, to a large number of vehicle-based terminals 920. The system 
900 includes two transmitters, 906 being a satellite-based transmitter, and 916 being a 
terrestrial-based transmitter. Satellite system 900 includes a server 902 which 
includes the above-described encoder 210/310 (and protocol converter 220/320 if 
needed), a satellite uplink 904, and a satellite-based transmitter 906 configured to 

35 communicate data to vehicles within a first coverage area 930. A terrestrial-based 
transmitter includes a second server 912 which also includes the aforementioned 
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5 encoder 210/310 (and protocol converter 220/320 if needed), a transmission line 914, 
and a broadcast tower 916 operable to provide the coded transmission to vehicles 
within a second coverage area 940. The complementary use of terrestrial broadcast 
towers or other communication means may be advantageous to cover gaps or provide 
coverage in those areas where satellite coverage may be unable to reach. Coverage 
10 areas 930 and 940 are shown as overlapping, although gaps may exist between 
coverage areas in alternative embodiments under the present invention. 

[0106] Several vehicles 920 are located within the coverage areas 930 and 940. 
Vehicles 920i and 920 2 are in motion within coverage area 930 and receive the coded 
transmission 1 15a from the satellite-based transmitter 1 10a at the data rate provided 

1 5 thereby. Vehicle 920 3 is parked with its ignition switched off, and as a result may not 
receive the coded transmission 1 15a. Optionally, Vehicle 920 3 includes a power 
supply which continues supplying power to its receiver, thereby permitting it to 
continue receiving the coded transmission when parked. Vehicle 9204 is located in 
the overlapping regions of 930 and 940. Vehicle 920 5 is within the second coverage 

20 area receiving the coded transmission 1 1 5b at its transmission rate. 

[0107] Each of the transmitters 110 may comprise a single- or multistage encoders 
as described in Figs. 2 A or 3 A, respectively. In addition, the pre-encoding data 
segmenting process described in Figs. 8A-8C may be employed. Each of the 
receivers preferably includes a decoder of the same type (i.e., single- or multistage) 

25 used in the system's transmitter. Further, the decoder may employ the inactivation 
process as described above. In a particular embodiment, the receiver is powered by a 
12 Vdc supply of other voltage supply provided by the vehicle's battery, and is 
integrated within the navigation receiver. The receiver may include software 
executed within a flash-based microprocessor/microcontroller which controls the 

30 navigation system to perform the reception, protocol conversion and data decoding 
functions as described herein. 

Solution for Broadcasting to Mobile Handsets 

[0108] Fig. 9B illustrates another embodiment of the present invention comprising a 
system for broadcasting live streaming data to a large number of mobile handset 
35 terminals. Live data may comprise news, financial information such as a stock ticker, 
a live sporting event, or some such similar content. 
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5 [0109] The system includes a server 952 comprising an encoder (and protocol 

converter, if necessary), a communications backbone 954, and communication towers 
956 x (956 3 shown as temporarily inoperable). Mobile terminals 958 x may be cellular 
telephones, computers able to receive the coded transmission 115 wirelessly via 
802. 1 lx radio cards, personal digital assistants, or other similar wireless mobile 

10 terminals. The system 950 further includes a secondary channel 959, shown as a USB 
(universal serial bus) connection to which mobile terminal 9583 connects to receive 
the coded transmission 115. As above the encoder may comprise the single- or 
multistage encoder, and preferably includes the post-encoding data interleaving and 
partitioning processes described for live streaming applications in Figs. 7A-7C above. 

15 Further, the encoding processes may include the pre-encoding data segmenting 
process to further decrease transmission delay. 

[0110] Mobile receivers 95 8 X will preferably employ decoders (single- or 
multistage) matched to their system's encoder. In some embodiments, the decoding 
process will include the symbol deactivation processes described in Figs. 8A-8D. The 
20 mobile handset may include software executed within a flash-based microprocessor 
which controls the handset to perform the reception, protocol conversion and data 
decoding functions as described herein. 

[0111] While the aforementioned receivers have been described as mobile, in other 
embodiments the terminals will be stationary, for instance, where the receiver loses 

25 signal reception intermittently due to its location on the boundary of a covered area, 
or failure or relative movement of the broadcasting source. Further, the systems and 
methods of the present invention may be used to facilitate communication between 
any type of transmitter and receiver, not only to those receivers characterized as 
intermittently available. Those skilled in the art will readily appreciate that the 

30 features of the present invention can be equally and advantageously applied to 

receiving systems which are configured to continuously receive data, as well as to any 
broadcast system in which highly efficient communication to multiple receivers is 
desired. 

[0113] The foregoing description has been presented for purposes of illustration and 
35 description. It is not intended to be exhaustive or to limit the invention to the precise 
form disclosed, and obviously many modifications and variations are possible in light 
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of the above teaching. The described embodiments were chosen in order to best 
explain the principles of the invention and its practical application to thereby enable 
others skilled in the art to best utilize the invention in various embodiments and with 
various modifications as are suited to the particular use contemplated. It is intended 
that the scope of the invention be defined by the claims appended hereto. 
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